Computer number format

Results: 271



#Item
1Computer arithmetic / Mathematics / Computing / Data types / Software engineering / C++ / Primitive data type / Integer / C++ classes / Computer number format / Comparison of C Sharp and Java

Reminder:  Lecture  slides ● Lecture   slides  are  posted   online  and  are  available  before   class ● Use  these  during  class  and  outside   of  class! ● If  you  can,  download   the

Add to Reading List

Source URL: cs.brown.edu

Language: English - Date: 2015-09-17 13:38:41
2Software engineering / Computer programming / Computing / Source code / Type theory / Holism / Subroutine / University of Cambridge Computer Laboratory / Macro / Constant / Variable / HindleyMilner type system

TRANSFORMING MULTIPLE-RECORD DATA INTO SINGLE-RECORD FORMAT WHEN NUMBER OF VARIABLES IS LARGE. David Izrael, Abt Associates Inc., Cambridge, MA David Russo, Independent Consultant ABSTRACT In one large survey project eac

Add to Reading List

Source URL: www.ats.ucla.edu

Language: English - Date: 2016-08-17 18:18:26
3Computer arithmetic / Mathematics / Arithmetic / Mathematical analysis / IEEE 754-1985 / Single-precision floating-point format / Double-precision floating-point format / Denormal number / Rounding / Pi / Precision / Approximations of

Lineare Algebra Endliche Arithmetik Walter Gander ETH Z¨ urich

Add to Reading List

Source URL: www.cvg.ethz.ch

Language: English - Date: 2015-06-05 11:10:36
4Computer arithmetic / Computing / Mathematics / Mathematical analysis / Normal number / IEEE floating point / Decimal64 floating-point format / Double-precision floating-point format / Decimal128 floating-point format / Decimal32 floating-point format / Rounding / Exponential function

Worst Cases for the Exponential Function in the IEEE 754r decimal64 Format Vincent Lefèvre, Damien Stehlé, Paul Zimmermann LORIA / INRIA Lorraine JNAO 2006

Add to Reading List

Source URL: www.vinc17.org

Language: English - Date: 2015-06-18 06:12:50
5Computer arithmetic / Computing / Mathematics / Double-precision floating-point format / Q / Exponentiation / Denormal number / NaN / IEEE 754-1985 / Single-precision floating-point format

Denison University Floa.ng Point
 
 CS-281: Introduc.on to Computer Systems

Add to Reading List

Source URL: personal.denison.edu

Language: English - Date: 2015-12-02 11:24:11
6Computer arithmetic / Arithmetic / Binary arithmetic / Mathematics / Lexicology / Numeral systems / Elementary arithmetic / Hexadecimal / Hexadecimal numeral system / IEEE floating point / Computer number format / Rounding

A Program for Testing IEEE Decimal–Binary Conversion Vern Paxson CS 279 Prof. Kahan May 22, 1991

Add to Reading List

Source URL: www.icir.org

Language: English - Date: 2008-11-12 02:02:36
7Mathematics / Computer arithmetic / Smalltalk / Number / Single-precision floating-point format / Primitive data type / Continued fraction / Q / Arbitrary-precision arithmetic / Floating point / Fixed-point arithmetic / Real number

Introduction to Smalltalk - Chapter 5 - Numbers  Ivan TomekChapter 5 - Numbers Overview VisualWorks library contains many classes representing numbers of various kinds, mainly because

Add to Reading List

Source URL: sdmeta.gforge.inria.fr

Language: English - Date: 2014-10-09 10:38:17
8Computing / Color space / Graphics file formats / Computer arithmetic / Error diffusion / Image processing / Lookup table / RGB color model / Dither / SRGB / Rounding / Computer number format

High-speed Conversion of Floating Point Images to 8-bit (online IDBill Spitzak, Digital Domain ∗ Introduction Most rendering software today destroys precise lighting and shading calculations by doing an inaccura

Add to Reading List

Source URL: spitzak.github.io

Language: English - Date: 2014-11-18 22:38:27
9Computer arithmetic / Mathematics / Arithmetic / Mathematical analysis / Floating point / IEEE 754-1985 / Single-precision floating-point format / Double-precision floating-point format / Denormal number / Rounding / Pi / Precision

Lineare Algebra Endliche Arithmetik Walter Gander ETH Z¨ urich

Add to Reading List

Source URL: www.cvg.ethz.ch

Language: English - Date: 2015-06-05 11:10:36
10Computing / Software engineering / Computer programming / X86 instructions / Software bugs / Memory management / Computer errors / C standard library / Buffer overflow / Printf format string / NOP / Magic number

cs281: Introduction to Computer Systems Project Lab 4: The Buflab – Designing a Buffer Overflow Attack Distributed: Wednesday, Oct. 14, Due: Monday, Oct. 26, 11:59 p.m. Introduction

Add to Reading List

Source URL: personal.denison.edu

Language: English - Date: 2015-11-10 08:26:32
UPDATE